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actual number of participants assigned to the program and as a lottery, so each participant — whether a student, a 

control conditions, carefully thought out by the evaluator, classroom, a teacher, or a school — has the same chance of 

is based on statistical considerations such as the “size” ending up in the intervention or the control group. For 

of the impact one wants to detect and the chances of instance, in our hypothetical math program, imagine that 

observing large impacts by chance. each classroom is given a number on a slip of paper. The 




c 

03 



(U 

F! 

M-i 

a 

jC 

CO 

C 

03 



: s 

o 

o 

w 

CO 

CO 



g S 

bJD 5 

ut C 

j:: .ti 

. « ^ 

C g 00 

15 ^ E 



u 



d) 

4-i 

6 

o 



d) 

u 

03 



d> 

C 



D 

a, 



S 

03 

Ui 

bJD 

O 



a 

d) 
j:: 

^ 03 

P CO 
d) 

d) c 

03 ^ 

Q. C 

M- d) 

Oh ^ 
CO -q 



•£ J 

S 

03 

C _T 
M) 

O 



^ CO .M 



d> 

-q 



d) 

u 

O 



C 

d) 

6 

S) 

’ V3 
CO 

03 

d) 

M 



d) 

o 



u 

03 



03 .ti .g 



-o 

C 

o 

u 

q 

’+-• 

c 

d) 

> 



W) 

g 

3 

S 



q 

o 



'TD 

q 

o 

u 

d) 

c 

o 



o o 

. CO 

'q d) 
d) u 

q q 

bX) « 

53 

[o u 
<L) 

d) «q 



q 

d) 

no 

q 



d> 

0 Ou 
to ^ 

01 d> 

s 3 



3 

O. 

S 

o 

u 



CO g 

s ^ 

o ^ 
O g 

ui o3 

CO *H 



T3 

q ^ 
o 
u 



<u 

E 
»-( 
tn .P 



Vh 

d) 

Dh 



o 

E 



'T^ 



g CO 

q 

^ o 

2 i :e 

3 



d) 

•s 

o 



q 

o 

u 



d) 

3 



E 

o 

-T3 

q 

Ul 

bJD 

q 



2 -g S 

u jCi 
O ^ 

q 
o 



q 

d) 
g d) 



03 



03 <U 



O 

Uh 

d) 

jS 



o 

E 

n 



1- 
d) 

u 
q 

d> 



jq 

H 

bi) 

q 



d> 

bJD 



<u 

-q 

4~» 

q 

_o 

q 

u 

q 



rq 



d) 

-q 



Dh 'T3 

3 >. 

bJD 'c 

S O 

^ "O d) 

c3 .q 

u d) w 



JJ 

3 

q 



d) 

bO 

q 

4-» 

q 

rt 

> 

q 

.s 

E 

E 

d> 

-q 



q 

cb 

u 

d> 

jd 

q 



° -E 
iH q 

Dh bO 

E Si 
"Z 

E -G 

q 

bJD .i:: 

2 

Ul H-> 

Dh q 

^ "E 
d) q 

C ^ 

CO 



^ a 



jq 

bJO 



d) 

jq 



u 

q 

Dh 

E 

q 

q 



q 

jC 



d> 

u 

3 



d> d) 

"Dh 'S 

E 

O o 

U CL) 



O 

q 

E 

q 

iH 

bJD 

o 

iH 

Dh 



q q 3 
d) -q 

■§ 1 
rr> ’nn 



d) 



•q o 
c 

<u rq 

I 

bJO 

.Sh -*-* 
CO 03 
CO rj 

03 q 



03 

q 



0 

1 

q 

d) 

q 

cb 

u 



q 

q 

u 

d) 



03 

jq 



u 

. q 



d) 

-q 



Ui 

O 

q 

.2 

*q 

05 

> 



S <u 

E ^ 



q 

Uh 

bO 

O 



q 

d) 

E 

d> 

o :s 
.q ^ 

rq u 

3 ‘53 

03 JO 

q (u 

d) u 
'Tq q 
q d> 

4-> o 

M-4 3 

o .E 



Vtsa, 

o 

OJ 

C/i 









cS 

t#) w 



q 

q d) 

jq -q 



u 

d) 

JC 



d) 

q 
E 

CO d) 
<u -M 

u 

n O 

O 4-> 
^ >s 

s 

dj CO 



u 

D. 

E 



d) c 

E 

o q 



(9 

o 

L. 

^ a. 
o a. 

*=“ ^ 
>s ^ 

-C o 

> ^ 
> fg 



U4 q 

<U d) 

o 5 
vh q 

q bO 

qj • ^ 
CO 
CO 

q 



d> 



o 

'Tq 

q 

03 



ERIC 



effect of a new program. One example of an alternative motivation, quality of teaching, expectations for students, and 

approach is a simple “pre-post” comparison. Here, using student motivation. So if we do see an improvement in 

our new math program again, the study would compare student performance in the classrooms that implemented the 

students’ math test scores before they participated in the program, it is possible that this improvement is the result 

of pre-existing factors other than the interventions, like 
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